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Abstract 

We  have  contributed  in  three  general  areas  that  are  relevant  to  high  performance  control  of 
aerospace  vehicles. 

We  have  developed  systematic  techniques  for  real  time  optimization  using  the  method  of 
extremum  seeking.  This  method  is  now  highly  general — applicable  to  multivariable  problems, 
to  problems  with  time-varying  parameters,  to  problems  involving  slow  dynamics  where  fast 
convergence  is  demanded,  to  problems  where  the  objective  is  convergence  to  any  value  of  the 
gradient  (not  just  zero),  to  problems  that  involve  limit  cycles  (unsteady  extrema),  and  to 
problems  that  evolve  in  discrete  time.  Examples  of  applications  that  we  have  pursued  include 
formation  flight,  compressor  stall  and  surge,  and  thermoacoustic  combustion  instabilities.  In 
2003  we  published  a  research  monograph  on  extremum  seeking. 

In  the  area  of  flow  control  we  have  pioneered  the  use  of  stabilization  for  drag  reduction  and 
mixing.  Employing  Lyapunov  techniques,  we  have  solved  flow  control  problems  in  channels, 
pipe  geometries,  flows  around  bluff  bodies,  and  jet  flows.  In  2002  we  published  the  first  book 
dedicated  to  control  algorithm  design  for  fluid  flows. 

For  a  broad  class  of  linear  parabolic  distributed  parameter  systems  we  pioneered  a  back- 
stepping  method  for  solving  the  boundary  control  stabilization  problems.  This  is  the  first 
method  that  yields  explicit  solutions  for  both  the  control  laws  and  for  the  closed-loop  so¬ 
lutions.  The  implications  of  this  are  impossible  to  overstate — the  design  is  direct  and  free 
of  numerical  issues,  and  the  well  posedness  analysis  is  trivial  (it  is  a  bonus  to  the  explicit 
design  process).  For  several  nonlinear  PDEs  we  solved  global  stabilization  problems  in  the 
presence  of  parametric  uncertainties  and  input  dynamics,  paving  the  way  for  a  future  general 
theoretical  development  for  nonlinear  PDEs. 
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1  Summary  of  Results 

Extremum  Seeking  Control  [K2].  Motivated  by  on-line  optimization  problems  in  aero¬ 
engines,  formation  flight,  bioreactors,  and  automotive  traction  control,  the  PI  developed  the 
technique  of  extremum  seeking  control.  Extremum  seeking  emerged  in  the  1940’s  with  a 
great  deal  of  promise  but  was  abandoned  in  the  1960’s  after  efforts  to  make  it  systematic 
failed.  The  PI  revived  it  by  creating  the  necessary  analytical  methodology  for  performance 
improvement  and  an  extension  to  multivariable  optimization.  The  book  [K2]  summarizes 
the  efforts  of  four  of  the  Pi’s  graduate  students.  Extremum  seeking  is  currently  used  in 
applications  in  United  Technologies,  Pratt  &  Whittney,  and  Ford. 

Flow  Control  [Kl].  The  Pi’s  efforts  in  flow  control  concentrated  on  developing  methods 
that  are  unique  in  their  implementational  simplicity,  while  avoiding  any  analytical  simplifi¬ 
cations  of  the  problem  (linearization,  discretization)  common  in  this  area.  The  monograph 
[Kl],  the  first  book  on  the  topic,  overviews  the  results  on  stabilization  by  the  Pi's  four 
students/postdocs  and  other  contributors  to  the  field  of  flow  control,  while  also  pioneering 
feedback  methods  for  control  of  mixing. 

Other  Applications.  The  PI  has  made  contributions  in  several  other  areas  of  control 
applications:  rotating  stall  in  jet  engine  compressors  [K3,  K10,  K12],  thermoacoustic  insta¬ 
bilities  in  combustors  [K5,  K16,  K30],  satellite  control  [K4],  underwater  vehicles  [K8],  heli¬ 
copter  blade-vortex  interaction  noise  [K9] ,  control  of  aircraft  formations  [K25] ,  bioreactors 
[K7],  chemical  tubular  reactors  [K22],  solid  propellant  rocket  instabilities  [K23],  pulsed  deto¬ 
nation  engines  [K31],  and  mine  ventilation  networks  [K26].  His  techniques  for  compressors 
and  combustors  have  been  patented,  after  experimental  verifications  at  Caltech,  Louisiana 
State  University,  and  United  Technologies. 

Control  of  Systems  Modeled  by  Partial  Differential  Equations.  The  PI  and  his 
two  postdocs  (with  degrees  in  mathematics)  have  open  a  new  area  of  control  of  distributed 
parameter  systems — boundary  control  by  the  method  of  backstepping.  In  [K19,  K21,  K24] 
they  developed  feedback  transformations  in  the  form  of  integral  operators,  combined  with 
boundary  control,  that  transform  a  wide  variety  of  parabolic  equations  into  simple  heat 
equations.  They  also  developed  nonlinear  controllers  for  several  benchmark  PDE  systems: 
Burgers’  equation  [K6,  K13],  Korteweg-de  Vries  equation  [K14,  K20],  Kuramoto-Sivashinsky 
equation  [Kll],  and  the  thermal  convection  loop  [K18].  They  addressed  PDE  problems  with 
not  only  nonlinearities  but  also  other  practical  constraints  like  actuator  dynamics  [K15]  and 
unknown  viscosity  parameters  [K17],  obtaining  results  valid  for  arbitrarily  large  initial  data. 


2  Example  of  Results:  Boundary  Control  of  Dis¬ 
tributed  Parameter  Systems 

State  Feedback.  We  have  developed  boundary  control  laws  for  a  wide  class  of  linear 
parabolic  differential  equations.  An  example  that  is  light  on  notation  but  still  quite  illustra- 
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tive  is  the  plant 

ut(x,t)  =  uxx(x,t)  +  X0u(x,t) ,  (1) 

where  x  £  (0, 1)  and  A0  is  constant  and  the  uncontrolled  boundary  condition  is  u(0,  t)  =  0.1 
The  control  law 


„(M)  =  - 

o  \/A(l  -y2) 


A  =  Aq  +  c 


(2) 


achieves  asymptotic  stabilization.  The  symbol  I \  denotes  the  modified  Bessel  function  of  the 
first  order.  What  is  particularly  striking  about  backstepping  approach  is  that  the  closed  loop 
solutions  can  be  found  explicitly: 


u(M)  =  re-^>' 


27TO 


:  sin(\/A  +  ir2n2x) 


ri—  1 


yj\  +  7 r2n2 

x  ^sin(Trnf)-  ^  £  ~  ^  j=  ~=^  sin(7rn??)  di^  u0({)  d(  (3) 

«  \/Kv2  ~  r ) 

0 

and  the  closed-loop  control  signal  is  obtained  by  evaluating  (3)  at  x  =  1.  The  function  u0(£) 
denotes  the  initial  condition/profile. 

Another  quick  example  is  the  system 

=  uxx(x,  t)  -I-  gu(0,  t) ,  (4) 

where  g  is  constant  and  ux(0,t)  =  0  at  the  boundary.  This  type  of  dynamics  arise  in 
instabilities  in  solid  propellant  rockets.  The  term  u{x  =  0,  t)  appearing  on  the  right  hand 
side  of  the  PDE  is  the  result  of  end-domain  burning  affecting  the  thermal  dynamics  within 
the  domain.  We  design  the  control  law 


u(M) 


=_  r 


yfg  sinh(v/g(l  -  y))u(y ,  t )  dy . 


(5) 


In  addition  to  the  explicit  control  law,  the  closed-loop  solution  is  compact  enough  to  write: 

oo  ,  7  g;vg  (cos  ((irn  +  § )  x)  -  l)  +  cos  ((irn  +  f )  x) 


71=0 


1  + 


(™+f) 


fl  Uo(0  fcos  +  (-1  r-^77  sinh(Vff(l  -  0)^  <% .  (6) 


7rn+ j 


A  third  example  is  the  system 


ut(x,t)  =  'U'xx  {x,t)  + 


2a2 


cosh2  (ax  —  fi) 


u(x, t ) 


(7) 


1The  open-loop  system  (with  homogeneous  Dirichlet  boundary  conditions)  is  unstable  with  arbitrarily 
many  unstable  eigenvalues  (as  Aq  grows). 
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(8) 


with  a  boundary  condition  u(Oyt)  =  0,  for  which  we  design  the  stabilizing  control  law 

tt(l,  t)  =  -  ^  aeatanh/5(1_y)[tanh/3  -  tanh(/3  -  ay)]u(y,  t)dy . 
o 

The  right  hand  side  of  the  system  (7)  may  appear  too  exotic  to  be  general  but  it  is  actually 
quite  general.  The  x-dependent  “coefficient”  multiplying  u(x,t)  is  parametrized  by  cx  and 
Q  and  this  parametrization  spans  a  family  of  “peak” -shaped  functions  with  an  arbitrary 
location  and  height  of  the  peak  parametrized  by  a  and  / 3 .  For  instance,  the  widely  studied 
chemical  tubular  reactor  PDE  control  models  can  be  described  using  this  parametrization 
(the  spatially- varying  “coefficient”  arises  due  to  a  nonlinearity  in  the  problem). 

Output  Feedback.  Consider,  as  an  example,  the  plant  ut(x,t )  =  uxx(x,t )  +  \0u(x,t), 
u(0,t)  =  0,  ux(l,t)  =  U(t),  where  U(t)  is  the  control  input  (open-loop  in  the  observer 
problem;  feedback  in  the  stabilization  problem).  Our  observer  design  procedure  results  in 

Ut(x,t)  =  Uxx(x,  t)  +  XqU(x,  t)  +  — — — 2 -^2  (\/A(l  —  x2)^[u(l,t)  —  w(l,t)]  (9) 

- - ' 

U*(M)  =  u(t)-^[u(l,t)-u(l,t)},  (10) 

with  u(0,t)  =  0,  where  A  =  A0  +  c,c  >  0.  We  stress  that  the  observer  is  convergent  for 
any  type  of  input  U{t)  applied.  In  particular,  if  the  system  is  unstable  and  U(t)  =  0  is 
applied,  the  observer  state  u(x,  t )  will  converge  to  the  (diverging)  u(x,  t )  (in  maximum  norm, 
for  example).  The  backstepping  controller  employing  the  state  estimates  is  designed  as 

ux(l,t)  =  U(t)  =  -^u{l,t)~  f  rr^—2h  ( \/A(l  -  y2)^  u(y)  dy .  (11) 

The  central  point  of  our  backstepping  observer  design  procedure  is  the  selection  of  the  output 
injection  gain  functions,  which  are  underbraced  in  (9)  and  (10).  A  quick  comparison  between 
the  controller  and  the  observer  shows  that  they  are  dual  in  a  particular  sense. 

We  re-emphasize  that,  with  every  element  of  our  design  being  explicit,  the  closed  loop 
solution  can  be  derived,  it  just  takes  a  bit  more  effort  due  to  the  presence  of  a  second  PDE— 
the  observer.  The  solution  is  given  by 


OO  ,  .  2\ 

u(x,t)  =  e  c+(,rn+2)  t(j>n{x ) 

n— 0 

X  |  '  -  (“!)n  1^71+  > 


(  p\  f  _ _  j  __  eir2(n-m)(n+m-f  l)t  ^  ^ 


m  —  0 
m^n 


7 r2(n  -  m)(n  +  m  +  1) 


a 


i  i<i2) 
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where 


<t>n{x)  = 


27rn  +  7r 


+  ( Trn  +  f)“ 


.  /  /T  7  7T\2  \ 

nn  A  +  1 7rn  +  —  I  x 

A 


:  sin 


(13) 


cn 


=  sin 


in  ((nn  +  ^  aA  +  ^  ^  sin  (firn  +  ^\x\  d£  (14) 

(  f' Hi- e)~)  MO  1  MO(MO~  MO)  ■  (15) 

o  1  -  r  o 


Another  example  is  the  PDE  ut  =  uxx  with  a  boundary  condition  ux(0,t)  =  qu(0,t), 
where  q  is  a  constant  of  any  sign.  Negative  q  gives  rise  to  instability,  despite  the  fact  that 
the  system  is  governed  by  a  plain  heat  equation  in  the  interior  of  the  domain.  This  type 
of  a  boundary  condition  comes  up  in  solid  propellant  rocket  instabilities  and  it  models  the 
heat  release  on  the  burning  end  of  the  propellant.  We  choose  to  actuate  through  «(1,  t),  and 
for  sensing,  we  select  the  anti-collocated  architecture  (measuring  u(0,t)).  The  stabilizing 
compensator  can  be  derived  in  the  transfer  function  form  as 


r(  \  -  9_  ,  (*-g) CQsh(y/i) cosh(^/g)\ 

S  s  scosh(-v/I)  —  gcosh(y/g) 


(16) 


Advantages  of  the  Backstepping  Approach.  The  examples  above  show  that  the  back- 
stepping  approach  generates  explicit  boundary  control  laws  for  a  large  class  of  parabolic 
PDEs.  Relative  to  the  previous  approaches  this  implies  the  following  advantages: 

•  Simplicity  of  Implementation.  The  explicit  form  of  the  control  law,  where  even 
the  dependence  on  parameters  appears  explicitly  (in  addition  to  the  dependence  on 
the  spatial  coordinates),  is  achievable  only  with  this  method.  This  means  that  our 
controllers  come  as  ready-to-implement  families. 

•  Less  (Or  None)  a  Priori  Computation.  In  the  backstepping  design  there  are  nei¬ 
ther  open-loop  eigenfunctions  to  compute  (as  in  pole  placement),  nor  operator  Riccati 
equations  to  solve  (as  in  LQR). 

•  Assigning  Infinitely  Many  Eigenvalues.  In  contrast  to  the  pole  placement  method, 
backstepping  is  capable  of  assigning  infinitely  many  eigenvalues  to  the  locations  of  a 
heat  equation,  with  arbitrary  extra  damping  c  >  0. 

•  Easier  Analysis.  Possibly  the  most  significant  advantage.  With  backstepping,  bound¬ 
ary  control  of  PDEs  becomes  tractable  using  calculus.  With  control  laws,  and  even  the 
closed  loop  solutions,  given  explicitly,  design  and  existence  of  solutions  analysis  become 
accessible  to  anyone  who  knows  what  an  integral  is  and  how  to  solve  a  heat  equation. 
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